Skip to content

Conversation

@fredjoonpark
Copy link

Closes #846

Proposed Changes

Introduces an (optional) new WriteOption config, captureBackpressureData, which captures dropped data points on backpressure events.

Additionally adds another config called concatMapPrefetch - previously, the client was calling concatMapMaybe with an undocumented prefetch value (source). This matters because prefetched batches are removed from the buffer and needs to be accounted for during testing. Made this configurable with the default set as what it's been using.

  • added guards and missing tests for WriteOption boundary conditions (ie. buffer limit, exponential base)

Checklist

  • CHANGELOG.md updated
  • Rebased/mergeable
  • A test has been added if appropriate
  • mvn test completes successfully
  • Commit messages are conventional
  • Sign CLA (if not already signed)

@codecov-commenter
Copy link

codecov-commenter commented Nov 4, 2025

⚠️ Please install the 'codecov app svg image' to ensure uploads and comments are reliably processed by Codecov.

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 88.81%. Comparing base (dd37956) to head (e92640e).
❗ Your organization needs to install the Codecov GitHub app to enable full functionality.

Additional details and impacted files
@@             Coverage Diff              @@
##             master     #848      +/-   ##
============================================
+ Coverage     88.51%   88.81%   +0.29%     
- Complexity      787      791       +4     
============================================
  Files           174      174              
  Lines          7207     7248      +41     
  Branches        405      413       +8     
============================================
+ Hits           6379     6437      +58     
+ Misses          697      680      -17     
  Partials        131      131              

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@fredjoonpark fredjoonpark force-pushed the capture-backpressure branch 2 times, most recently from 3cd2b34 to 84e6774 Compare November 5, 2025 00:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add captureBackpressureData WriteOption to preserve dropped points

2 participants